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BACKGROUND 


: Statement of the Problem 

As new aircraft become more sophisticated, the ability of these 
aircraft to perform their mission becomes increasingly dependent on 
Rien avionics subsystems. The availability of operating avionics subsystems 


is emerging as the critical factor in the operational readiness (sortie 


generation capability) of an aircraft weapon system. Recent experience 
with the F-15 demonstrates this. In late 1979, HQ TAC advised the ASD 
Commander, General Lawrence A. Skantze, that F-15 avionics support had 
surfaced as a critical problem. General Skantze decided there was a need 
to evaluate the process of acquiring avionics and its support. He asked 
the Deputy for Engineering (EN) to investigate the acquisition of avionics 
and its support from an engineering perspective. Colonel John S. Kubin 
(Assistant Deputy for Engineering) chaired the study advisory board and 
Mr. Brian Freeh (ENEGA) served as study director. 

This problem is-visible to field personnel as an inability to achieve 
scheduled sortie rates due to a lack of avionics LRU replacements. Many 
factors impact the availability of LRU replacements. These factors include 
‘ LRU spares investment, maintenance manning, personnel experience, avionics 
reliability, built-in test (BIT) performance, test equipment reliability, 
. test equipment quantities, test equipment spare parts investment, and 


‘ maintenance concepts, policies, and procedures. 


Approach 


A meaningful evaluation of the problem required a method of describing 


anc vantif sg how the above factors interact, and what is their impact 


on avionics availability. Systems analysis cechniques provided the most 


appropriate means for handling such a complex, multi-faceted problem. 
The Logistics Composite Model (LCOM) was selected as the primary analytical 


tool for the following reasons: 


1. LCOM allows a detailed description of the many reliabilicy, 
maintenance, logistics, and operational factors impacting a weapon system's 


performance. 


2. As a computer simulation model, LCOM provides the most realistic 


means of examining the complex interaction of these many factors. 


3. LCOM ties the interaction of these many factors to sortic 


generation. Sortie production may be used as the critical performance 


measure. 


4. LCOM facilitates trade-off and sensitivity analyses. 


The F-15 weapon system was selected as the experimental model for 


the study. This decision was made for che following reasons: 


1. The F-15 was a mature system. 
2. An LCOM database for the F-15 had been developed by HQ TAC/XPM. 
3. This database would be available in a short time. 


4. Problems being experienced with F-15 avionics had initiated the 


53. The F-15 was a new generation high technology fighter which made 


it an excellent model for future weapon systems. 
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Extensive efforts were made to gather and validate data on F-15 
subsystems, both avionics equipment and intermediate shop test equipment. 


This data was used to update the database obtained from HQ TAC. 


System Description 


Figure 1 describes an aircraft avionics supply system. It is this 
system which determines avionics availability. Sortie requirements drive 
the system. Total sorties produced provides a measure of system per- 
formance. Sortie production is determined by the request rate and the 
availability of operationally ready (OR) aircraft. This system considers 
the availability of avionics as the sole determinant of an aircraft's 
operational status. If a needed replacement LRU is available from supply, 
then the aircraft will become OR and can satisfy a sortie request. If 
a needed LRU is not available from supply, then the aircraft will be down 
due to an avionics "hole" and cannot meet a sortie request. The supply 
pool initially contains the number and type of LRUs specified by the F-15 
WRSK list. As the system is driven, broken LRUs are removed and sent to 
the avionics intermediate shop (AIS), good LRUs are taken out of supply 
and used to fill aircraft "holes", and repaired LRUs are returned to supply 
from the shop. Avionics LRUs can be found in three places in the system: 
supply, on-board aircraft, and in the shop. In addition, the system does 
"leak" a percentage of certain LRUs to the depot. Supply is augmented by 
cannibalizing good LRUs from aircraft with other “holes", and using these 
good LRUs to fill unsatisfied replacement demands. The demand rate against 
supply is equal to the removal rate from the aircraft pool. These two 


rates are based on flying hours and determined by actual LRU reliability 


and the frequency of troubleshooting errors. The critical point in the 
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system is the shop. LRUs can become backed up if the shop is unable to 
handle the workload. Shop production is dependent to a great extent on 
the intermediate test equipment. Each LRU must be processed by a specific 
test station. If a test station is processing another LRU, busy being 
repaired, down due to a shortage of spare parts, or idle due to a shortage 
of maintenance technicians, backups will occur. All resources are present 
in the system in limited quantities. 

Systems analysis requires the careful development of an accurate 
system flow diagram. Such a flow diagram defines and limits the system 
under consideration. LCOM analysis is primarily systems analysis, and as 
such should always include the development and use of a system flow diagram. 
Normally, a system diagram would be created first so as to facilitate the 
development of a computer model. In this case, however, the model (LCOM 
and the corresponding F~15 database) already existed and was being applied 
to a specific problem. The computer model was assumed to accurately 
replicate the real system in great detail. The flow diagram was developed 
to better understand and explain the complex interactions taking place in 


the computer model, and to better relate the model to a real world. 


Objective 


The objective of this LCOM effort was to evaluate the many factors 
impacting avionics availability, identify the crucial ones, and to assess 
the relative value of several alternatives designed to improve avionics 
availability. This was accomplished through sensitivity analysis and trade- 
off experiments using the F-15 model. Sortie production served as the 
primary performance measure in these analyses. Therefore, the specific 
goal of this analysis was to determine which factors affect sortie production 


the most. 


SIMULATION SCENARIO 


Scenario Development 


To accomplish the sensitivity and trade-off analyses required for the 
AAS, a rigorous scenario which pushes the F-15's capability to the limit 
was needed. This Limit had to be established for the baseline model so 
that sortie production would be sensitive to experimental parameter 
changes. The decision was made to develop an analytical scenario based 
on surge combat. It was more important for this scenario to provide an 
appropriate experimental framework than for it to conform to approved 
operational parameters. For this reason, the AAS scenario was not 
coordinated with HQ USAF or HQ TAC. That it might violate some real 
world parameter was not a serious concern. It did, however, incorporate 
many items from the sustained combat LCOM scenario developed by HQ TAC/XPM 
for the F-15. 

There are many problems encountered in trying to model a surge combat 
environment which were not resolved in this study. Although based on a 
surge combat flying program, WRSK sparing, and a forward base deployment, 
this scenario does not consider deferred maintenance, battle damage repair, 
air base attack, or chemical defense problems. In addition, the scenario 
assumes that sufficient quantities of munitions, pilots, fuel, flightline 
support equipment, and replacement aircraft are available. As such, the 
scenario actually describes a sortie surge exercise and not a true war. 
The analysis, therefore, is a surge capability assessment rather than an 
actual combat projection. 


AFR 25-8 states that any agency conducting an LCOM study must 


coordinate the proposed scenario with the MAJCOMs and Air Staff agencies 
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before simulation runs begin. It specifies HQ USAF/MPME as the focal 

point for HQ USAF coordination of scenarios. The regulation describes in 
detail what should be included in an LCOM scenario. This process, however, 
is currently a lengthy one which is appropriate only for manpower studies. 
No formal procedure exists for developing scenarios for non-manpower 
studies such as the Secretary of the Air Force Program Review (SPR) surge 


assessments, and the Avionics Availability Study. 


AAS LCOM Scenario 

Appendix A describes the AAS LCOM Operations and Maintenance scenario 
using the format suggested in AFR 25-8. A number of scenario items 
included in that description deserve further explanation. In addition, 
the AFR 25-8 format does not include some items which are of special 
importance. The following explanations offer background information on 


these important assumptions: 


1. A 48 PAA unit deploying to a forward operating location. A 48 PAA 


unit was selected for simulation because it is the largest unit planned 
to deploy with a single set of avionics test stations. This deployment 
option places the greatest strain on the overall avionics support system. 
A “worst case" approach was taken in establishing this baseline condition. 
In addition, a 1979 Rand study identified this deployment option as being 


a potential logistics problem. 


2. The existing 3-level maintenance concept. Organizational and inter- 


mediate levels of maintenance were modeled in detail. Depot maintenance 


is included in the model, but not in detail. Although the 3-level 


maintenance concept for the F-15 has been critized, this study assumes 

the current concept. Attempts were made to simulate a two-level main- 
tenance environment involving a Central Intermediate Repair Facility 
(CIRF), but were unsuccessful due to modeling problems and insufficient 
data. The model was successfully set up to simulate the absence of the 
intermediate shop during the 30-day simulation period, and excursions were 


made to investigate this contingency. 


3. The avionics intermediate shop (AIS) becomes operational on day 6. 


This assumption was made arbitrarily. Although not based on any approved 
operational plan or study, it is thought to be reasonable. Originally, 
the model was run with the AIS operational from day 1. Shifting the 
operational start day did not seem to significantly impact sortie results. 


No sensitivity analysis was attempted. 


4. Cannibalization allowed. The model was exercised in both modes: 
cannibalization on and cannibalization off. Sortie production was very 
sensitive to this factor. Turning cannibalization off resulted in a 30% 
reduction in sorties accomplished. Cannibalization is not only realistic 
in a spares constrained combat scenario, it is absolutely necessary to 
achieve maximum sorties. The actual LCOM cannibalization mechanism does, 
however, require close examination. It is complicated. Verifying its 
correct operation is essential. Consideration should also be given to 
the impact of the LCOM default values. These values allow five total 
"holes" in any aircraft, and restrict the number of parts an aircraft can 


receive by cannibalization at one time to two. 


5. War Readiness Spares Kit (WRSK) deployed with the 48 PAA unit. Seventy- 


five avionics components were identified for inclusion in the study. These 
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LRUs are all processed by the AIS. The WRSK list, prepared 9 April 1980, 
was obtained from Warner-Robbins Air Logistics Center (WR-ALC). Only 
these seventy-five parts were constrained. All SRU and piece parts are 
assumed to be available. Sortie production was very sensitive to LRU 
levels. 

There are a number of problems associated with using an actual WRSK 
list, assuming that it can be obtained from Logistics Command. There are 
often discrepancies between LRU work unit codes (WUC) listed in the WRSK 
and those in the model. In addition, a given WRSK list is not necessarily 
what is actually available to a particular unit. Different wings 
negotiate for changes in WRSK allocation. Units also have varying 
policies towards the peacetime use of WRSK spares. All of these factors 


effect critical spares levels. 


6. Manning constraint. The model includes twenty-nine different work 
centers. Only the six involved with organizational and intermediate 

level avionics maintenance were constrained during the course of this 
study. Manning levels for these work centers were taken from the TAC 

F-15 LCOM Manning Standards document for sustained combat. The three 
shift sustained combat authorizations should have been changed to account 
for the increased manhour availability assumed for surge activity. This 
error probably had little impact due to the model's relative insensitivity 
to the manpower constraint. Any excursion where an improvement to the AIS 
yielded a large jump in sortie production probably could have done even 


better with such an increase in shop manning. 


7. One spare for each test station drawer. The intermediate shop (AIS) 


is made up of seven test stations. Each test station is a package of 
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components contained in removable drawers. These components are subject 
to failure. Maintenance for the test station is accomplished cither by 
repairing a component in place, or by removiny the drawer containing 

the failed component and installing a spare drawer. The tailed component 
can then be repaired in the shop or at the depot. 

The majority of test station maintenance was modeled by TAC analysts 
as requiring drawer removal. ‘This resulted in a large demand for spare 
drawers. A WRSK list for the test stations was obrained from the San 
Antonio Air Logistics Center. This list included piece parts and 
integrated circuit cards, but few entire drawers. Since the model did 
not track individual piece parts and circuit cards, the only way to 
provision test station spares was to include complete drawers. The 
assumption was made chat an unlimited number of piece parts and circuit 
cards were available and that one entire spare drawer was available for 
every drawer contained in the AIS. The model was very sensitive to this 


assumption. 


8. Thirty day simulation period. Thirty days is considered to be a 


reasonable limit on the duration of surge combat activity. Scenario 
parameters change significantly after day thirty. This assumption 
influenced the method which was used to evaluate output results. A 
thirty day simulation period requires that the simulation be treated as 


terminating, and data analyzed accordingly. 


9. No resupply. It is generally assumed that surge combat must be 
conducted in the absence of resupply. Resupply is often considered to 
begin after day thirty. Excursions were run which investigated the 


impact of resupply during the surge period. This impact was considerable. 
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Again, for this study, a "worst case" approach was used. 


10. No attrition. Although the scenario is a combat scenario, many of 
the hazards of actual combat must be ignored. The available number of 
aircraft remains at 48 throughout the simulation period. This assumption 
does not necessarily mean attrition is not occurring. However, any 


aircraft lost in action are assumed to be replaced immediately. 


11. No battle damage. Battle damage would represent a significant portion 
of aircraft maintenance during a war. However, special modeling techniques 
must be employed to consider such maintenance. The time and data required 


to implement these techniques were not available for this study. 


12. Deferred Maintenance not modeled. Some maintenance would be deferred 


during surge activity to allow aircraft to turn rapidly. This consider- 


ation also requires special modeling techniques. These techniques have 


not been refined for easy and accurate use in LCOM. The question of how 
peacetime and wartime failure rates and maintenance requirements differ 
has not been answered. It is also very difficult to define what 
maintenance would be deferred and what would not. For the F-15, it was 


assumed that very little maintenance could be deferred. 


13. No weather impact. Weather certainly effects the operational 
scenario during combat. Adverse weather reduces the number of sorties 
which can be produced. It also restricts the hours available for launching 
sorties. The program which was used to generate the flying schedule for 
this study (Create 20) does include weather. However, to minimize the 
impact of this variable on the output of the model, weather parameters 


for Holloman AFB, New Mexico were used to generate the flying schedule. 
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The weather at Holloman is very good and generally does not effect F-15 
sortie production. For the purposes of this study it was necessary to 
ot restrict the number of variables affecting sortie production to as few 


as possible. 


= 14. No aircraft phase inspection. Many inspection requirements are 
waived during surge combat. The phase inspection clocks and networks 
were removed from the AAS model. This not only was a realistic operational 


re condition, but it reduced the computer requirements for running the model. 


15. No delay for base supply processing. Logisticians normally assume 

a four day delay before a repaired LRU returns to supply from the shop due 
to administrative processing. Not only was this delay unrealistic for 

the surge scenario being used, but it was not relevant to the system 
interactions of interest in this study. This delay was, therefore, 

4 assumed to be zero. Once an LRU was repaired in the shop, it was 

8 immediately available to be used as a spare. Excursions made with a 

‘ four day and a two day delay time demonstrated the model's relative 


insensitivity to this variable. 


o 16. A reduced database was used. As has already been mentioned, only 
avionics manpower and avionics LRUs were constrained during this study. 
In addition, many non-avionics subsystems were deleted from the database. 
Any subsystem which did not include at least one LRU processed by the AIS 


= was eliminated. This was done by deleting the subsystem clock and 


é 

ot corresponding networks from the database. Forty-three failure clocks out 
of approximately 250 were deleted. The largest portion of the model 

= remained intact. This reduction was designed primarily to reduce the 

a 


computer core storage and execution requirements for running the model. 


In addition, it focused attention on avionics and its support. 


17. Aircrews, munitions, and fuel not constrained. Again, important 


operational considerations were ignored to simplify the scenario and 


restrict the variables effecting sortie production. 


Flying Schedule Considerations 


Maximum sortie production has already been mentioned as being one 
of the primary considerations behind the development of the simulation 
scenario. Sortie production is obviously effected by the flying schedule. 
Not only is the rate at which sorties are requested important, but lead 
time, cancel time, mission length, minimum and maximum mission size, 
spare aircraft preparation, alerts, mission mix, length of day, and day/night 
sortie mix are all factors which impact sortie production. An LCOM flying 
schedule is not something to be taken for granted. 

A great deal of experimentation went into developing a flying 
schedule which makes maximum use of available aircraft resources. Eight 
different sortie request rates were tested. Figure 2 indicates the 
relationship which exists between sorties requested and sorties accomplished 
for an unconstrained AAS model. The figure refers to the model as the AIS 
model. That title was sometimes used to emphasize the study's emphasis 
on the avionics intermediate shop. Of particular note is that sortie 
production continues to increase, even if only minimally, at extremely 
high request rates. A request rate of approximately 3.9 sorties/aircraft/ 


day was used in the final flying schedule. 
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MODELING CONSIDERATIONS 


Reducing The Model 


The F-15 LCOM database acquired from HQ TAC was very large. The 
computer resources (CPU time and core storage) required to run the model 
were not only costly, but nearly exceeded the limits of our CDC computer 
system. Although the model ran easily within the resource limits of our 
Itel AS/5 computer system, the large number of excursions required for the 
AAS made it desirable to run simulations on both systems. To gain the use 
of the CDC system required a reduction in the execution core storage 
requirement of the model. This was accomplished, as mentioned previously, 
by eliminating the failure clocks and corresponding networks for forty- 
three subsystems not processed by the AIS. In addition, all scheduled 
maintenance clocks and networks, such as phase and wash, were deleted. 
These reductions not only permitted the use of both computer systems, 
but significantly reduced the cost of each simulation run. 

Reducing the size of a database is an ideal technique for analyzing 
specific subsystems. It not only saves time and money, but it focuses 
attention on the subsystems of primary concern. Constraining only certain 
parts and workcenters also economizes and aids in analyzing specific 
subsystems. 

There are, of course, some disadvantages associated with reducing 
a model. The model no longer can be applied to a variety of questions, 
but instead addresses a specific issue. Answers become increasingly relative 
and less absolute. Output results such as sortie rate and maintenance 


manhours per flying hour (MMH/FH) may be quite inaccurate and should be 


analyzed with caution. A variable that is left unconstrained may be a 
limiting factor. It was very late in the AAS that we discovered the 
significance of engine maintenance personnel. The TAC authorized manpower 
for the engine workcenter was insufficient and made that variable more of 
a limiting factor than avionics availability. This point went undiscovered 
previously because only avionics workcenters were being constrained. 
Appendix C contains a list of the subsystems which were eliminated to 
reduce the size of the database. Also listed are the scheduled maintenance 
clocks which were deleted. Appendix D lists the LRUs, maintenance work- 


centers, and test equipment which were constrained in the model. 


Limitations 
Inherent in the LCOM model are certain limitations. One of its major 
limitations prevented a successful investigation of the Central Intermediate 


Repair Facility (CIRF) maintenance concept. LCOM simulates the flying and 


maintenance activities at a single base. The CIRF is designed to handle 


the intermediate avionics maintenance for several bases. A CIRF serving 
three different F-15 bases was simulated by merely tripling the number 

of aircraft, the flying activity, the maintenance personnel and the number 

of WRSK spares. The number of test stations was doubled and appropriate 
delays were added to the supply networks to account for pipeline times 
between the CIRF and each base. Although this model did generate the 

correct workload for the CIRF, the resulting sortie generation rate was 
inflated due to the advantages of massing aircraft, manpower, and spares 

from three bases into a single resource pool. This massive pool of resources 
increased the probability of having an aircraft, a part, or a man when it 


was needed. This unrealistic economy of scale invalidated the CIRF model. 


Overcoming this problem would have required tripling the database to reflect 
the same networks and resources three separate times thus distinguishing 
each base and its resources. 
The massive data requirements of the model also limit, in practical 


ee terms, how detailed a model can be. It was impractical to include piece 


parts and shop repairable units (SRUs) for either avionics equipment or 


test equipment in the model. The model actually assumes the availability 


of piece parts and SRUs. This made it very difficult to accurately analyze 


test station downtime due to shortage of parts. The test stations are 
made up of removable drawers which contain integrated circuit boards, or 


SRUs. Maintenance and parts replacement usually takes place at the circuit 


card level. Test station spares are stocked at the circuit card level. 


However, the model included only drawers. The model stocked test station 


spares as drawers. This handicapped efforts to fully understand the 


impact of test station sparing. 


Test Equipment 


The F-15 model was one of the first to attempt an extensive treatment 


of shop test equipment. For the purposes of this study, the avionics test 


equipment was of great interest. Its inclusion in the model was crucial. 


The task of modeling test equipment is a difficult one. Many problems 
were encountered trying to accurately model and analyze its performance. 
As mentioned above, each of the seven AIS test stations consists of 
a set of drawers. Each LRU requires a specific test station and a given 


set of drawers (not the entire station normally) to run its test program. 


The time to run an LRU through its test program differs from LRU to LRU. 


Every test station drawer has a unique failure clock and unscheduled 
maintenance network that simulates a test station failure. A separate 
decrement is used for every LRU so that only the failure clocks of the 
drawers required by that LRU are decremented. When an LRU is being tested, 
the model requires the following resources be available to begin the task: 
the test station, each required drawer, and the station operator. If any 
of these resources is unavailable, then the LRU is placed in a queue 
waiting to be tested. This can happen when the test station (or any 
required drawer) is being repaired or used to test another LRU. 

The original database placed the drawer failure clock decrement and 
call to unscheduled maintenance before the actual repair task which uses 
the test station and drawers. We found this network scheme to be incorrect. 
When a queue began building at the test station and LRUs had to wait before 
being tested, they would still decrement the station's failure clocks as 
if they had already used the station. The result was that too many 
failures were being experienced for the number of LRUs «sich had actually 
been processed. This was corrected by putting the decrement and call to 
maintenance after the LRU had processed across tne station. 

Another major problem with test station modeling has already been 
mentioned. Since piece parts, subassemblies, and circuit cards (SRUs) are 
not included in the model, it is difficult to realistically simulate test 
station sparing. We assumed one spare drawer would be included in the WRSK 
for sats drawer in the model. Because some drawers fail often and are 
modeled as having a probability of being sent to depot (NRTS), it's not long 
before the test stations go down due to a shortage of spares (NMCS). T ‘s 
happened quite often and was one of the drivers behind the overall performance 


of the system. 
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Normally, failure clocks are established in terms of mean time between 


failure (MTBF) or mean sorties between failure (MSBF). The clocks for the 


test station drawers were originally given in terms of mean LRUs processed 
between failure. These clocks were based on data accumulated in the 

avionics intermediate shop at Langley AFB, Virpinia for the twelve month 
period January to December 1977. The AIS supported approximately 13,500 

F-15 sortics during that period. Data was manually recorded within the 

shop by the test station operators. In addition to providing drawer tailure 
rates, this data included maintenance task times for repairing failed drawers. 

The appropriateness of modeling test station failures in terms of LRUs 
processed is questionable. The original model decremented drawer failure 
clocks without regard to how long an LRU actually tied up the test station. 
LRUs that required ten hours to run their test program impacted the failure 
mechanism no more than LRUs which only took one hour. Although this scheme 
seems counterintuitive, there was no way of determining its actual impact. 
This mechanism was changed so that drawer tailure clocks now are in terms 
of operating hours (MTBF) and decrements reflect the average time an 
individual LRU takes to run its test program on the station. The original 
failure clock values are included in Appendix E. 

Serious difficulties were encountered in trying to verify the correct 
operation of the test station failure mechanism. Because the test station 
architecture is so complex, with each drawer having its own clock and each 
LRU requiring a different set of drawers for a different length of time, 
it is difficult cto determine analytically what the expected composite 
failure ra.e is for a particu’>r test station based on its input drawer 


failure clocks. In addition, it was not possible to separate testing time 
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from station maintenance time in the output statistics. Because these 

two times were lumped together as test equipment operating hours, it was 
not possible to determine a composite test station failure rate in terms 

of operating hours (actual time processing LRUs). If station operating 
hours for testing LRUs had been separated from operating hours due to 
station maintenance in the simulation output statistics, not only could 

a composite failure rate have been determined, but a Fully Mission Capable 
(FMC) rate could also have been computed. This separate reporting of 
operating hours and maintenance hours could have been accomplished by either 
requiring a dummy manpower resource on ali test station repair tasks, or by 
coding all LRU testing tasks as type 2 and all test station repair tasks 

as type 3. Since neither of these techniques was employed, the only 
available measure of test station reliability is in terms of LRUs processed 
per station failure. By painstakingly examining the hit matrix of a 
simulation output, the number of LRUs tested and the number of failures 

for each test station can be determined. 

Table 1 reports the reliability being exhibited by the three automatic 
test stations in the model. It also reports the results of an attempt to 
validate the model by examining the reliability of test stations in the 
field. Validation was difficult because data on test station performance 
was not readily available. What data was available was so inconsistent 
as to make it questionable. Table 1 indicates the inconsistencies in 
test station data from one base to another. Appendix F describes in 
detail how this data was obtained. Although the composite reliability 
values for the three bases seem to validate the model, the variance of 


the data certainly reflects a lack of consistent test station data. It 
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should be noted that no attempt was made to compare model failure clocks 
with field data for individual drawers. 

The problem of inconsistent data was again evident when an attempt was 
made to validate the LRU test times used in the model. Three sources were 
compared. Tables 2, 3, and 4 show the LRUs tested by each test station and 
the associated test times from each source. The LCOM database test times 
as determined by TAC using an operational audit of Langley AFB and Bitburg 
AB in 1977 are compared to 1978 job standard test times established at 
Bitburg AB and 1979 field survey times for all bases gathered by the F-15 
program office. 

A number of factors contribute to conflicting test time data. The 
skill level mix for AIS operators differs from base to base. The condition 
of test station hardware and software also differs from base to base. And 
test times may include different tasks at different bases. For instance, 
an LRU repair task time may or may not be reported as including equipment 
setup time, calibration, OJT, and test equipment maintenance. 

To summarize, drawer clocks and decrements appear in the model in terms 
of operating hours and test times, while the resulting failure rate must be 
calculated in terms of LRUs processed per failure. This turns out to be 
convenient since the field data used to validate the model is in similar 
terms. The model seems to replicate the rates experienced in the field, 
however, inconsistencies in the field maintenance data are present. There 
is no way of knowing what was the impact of putting the drawer failure clocks 
in terms of operating hours. It seems intuitively age correct, but the 
composite failure rate can only be validated from field data in terms of LRUs 
processed per failure. An so, this measure may be preferrable to operating 


hours. 
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ANALYSIS TECHNIQUES 


Analyzing a Terminating Simulation 


A terminating simulation is one run for a specific finite time period. 
Such simulations normally do not reach steady state. For this reason, 
performance samples taken at intervals during the simulation period often 
are not independent. Autocorrelation analysis should be employed to 
determine whether or not interim samples are independent. Samples which 
prove to be autocorrelated cannot be used in statistical analysis requiring 
independent observations. The only way to generate independent observations 
for simulations not reaching steady state is to replicate the entire 
simulation using different random number streams each time. The results 
from each replication may then be used in classical statistical analysis. 

A thirty day simulation of wartime flying activity is a terminating 
simulation. Autocorrelation analysis indicated that interim samples taken 
from the F-15 model were non-independent. For this reason, each experiment 
conducted for the AAS had to be replicated several times. 

Because a simulation replicates the real world through the occurrence 
of many randomly generated events, running the model with different random 
numbers yields different output responses. These outputs, or independent 
observations, are distributed around a mean value which is theoretically 
the true response value for a given set of inputs. Although an infinite 
number of runs would be required to determine exactly the mean value of 
a response variable, replications do provide an estimate of the true 
mean. Using a common statistical technique, a confidence band or interval 


about che estimate can be determined. This interval is referred to as the 


confidence interval. 


= 


Each experiment done for the AAS was replicated five to ten times so 
that a sample mean and a 90% confidence interval could be calculated. It 
was only after this had been accomplished that the analyst could compare 
the results of different experiments. This procedure is similar to a 
statistical test of means. In some cases, different experiments were 
compared using one of the several tests designed to establish that two 


population means are significantly different. 


Sensitivity Analysis 


Sensitivity analysis is one of the primary analytical techniques used 
in simulation studies. Shannon provides a concise definition and description 
of sensitivity analysis [1]. Simply stated, sensitivity analysis consists 
of systematically varying the values of input variables over some range 
of interest and observing the effect on the model's response. This 
technique has two primary uses. First of all, it can be used to help 
build confidence in the model. Sensitivity analysis can identify which 
variables have the greatest impact on model response. The analyst can use 
this knowledge to direct his efforts for validating the data and any 
assumptions associated with these important eagiubles: The confidence 
associated with these critical variables becomes the confidence associated 
with the entire model. 

The second way of using sensitivity analysis involves the evaluation 
of changes to the model. Alternatives can be compared and refined. New 
alternatives can be designed and investigated. This technique helps the 
analyst determine ways of improving the model's performance. It is a 
means of choosing the alternative which produces the most favorable model 


response. 
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Although not planned this way from the beginning of the study, our 
simulation analysis eventually was divided into two experimental phases. 
The first phase was primarily dedicated to validation of input data, 
verification of model performance, and identification of critical variables. 
Sensitivity analysis was employed heavily. The model's sensitivity to 
quantities of spare parts (both avionics LRUs and test equipment TRUs), 
numbers of test stations, manpower, LRU test times, arrival of the 
intermediate shop, test equipment reliability, prime equipment reliability, 
repair cycle time, cannibalization, resupply, weather, and length of flying 
day was evaluated. A great deal of field data for the avionics and the 
automatic test equipment (ATE) was reviewed and changes were made to the 
F-15 database. All underlying assumptions were examined, along with their 
impacts on model response, and some were changed based on the results of 
sensitivity analysis. 

The second phase of the study was devoted to evaluating the various 
alternatives for improving avionics availability. Again, sensitivity 
analysis was employed. The results of this analysis will be discussed 


in the next chapter. 


Factorial Experiment Design 


Designing an effective and economical experiment, or series of 
experiments, requires that the analyst know which input variables are 
the important ones, and within what practical range of values for each 
is the model most sensitive. The analyst, unfortunately, does not have 
such information at the beginning of his study. The answers to these 


important questions surface only after experimentation has been underway 
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for some time. For this reason, experimental designs are frequently 

* revised or even scrapped entirely as an investigation proceeds. Many such 
false starts and design revisions were encountered during the AAS. The 
sensitivity analysis already mentioned was a part of this process. 

The factors effecting avionics availability have already been 
mentioned. Each factor is represented in the model by one or more input 
variables. The experiments conducted for the AAS were designed to assess 
the relative impact each variable has on model response, specifically, 
sortie generation. For the most part, these experiments considered only 
one factor at a time. Such experimentation requires a simple design, 
and little complicated statistical analysis. This method, however, 
yields no information on the interaction between variables. A point was 
reached in the AAS when it was appropriate to investigate the interactive 
effects. A factorial design was chosen to accomplish this experiment. 

A factorial design involves all combinations of the chosen factors 


at each level of interest. With N factors cach having M different values 


ee 


or levels, a total of vu combinations must: be examined. In most cases, 

: as with the AAS, replications of each combination are required. For this 

- experiment, five replications were run for each combination. Four factors 
na (number of test stations, radar subsystem reliability, WRSK spares, and 

ATE reliability) were considered at two different levels for each. This 
resulted in a a4 factorial design having 16 total combinations. In addition 
” to measuring the interactive effects of each variable, a factorial design 
has the advantage of measuring the main efier:.s of each variable with 
greater accuracy than a design considering one factor at a time. The 


design presented by Box, Hunter, and Hunter [2], along with the algorithm 


for computing main and interactive effects, contributed greatly to this 
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effort. Results of this analysis will be discussed in the following 


chapter. 


WRSK Analysis 


Preliminary experimentation indicated that the model was very sensitive 
to spares levels. The list of war readiness spares provided inputs to the 
model for the initial on hand stock of avionics LRUs. These initial levels 
were clearly a constraining factor. Sortie generation was directly 
effected by any increases or decreases in input values for spares. A 
great deal of analysis went into understanding the importance of WRSK 
sparing and attempting to better evaluate WRSK requirements. 

Captain William Radcliffe, Jr., was responsible for a great deal of 
this analysis. He took a comprehensive and unique approach to analyzing 
WRSK requirements for the F-15 avionics suite. This analysis is explained 
in detail in his graduate school thesis [3]. 

Our analysis determined that the current WRSK was not optimally 
stocked for the dollars spent. Backorder statistics from simulation 
outputs indicated that some items were overstocked while other items were 
severely understocked. A redistribution of funds could yield a WRSK of 
the same cost which would make possible a significant increase in sortie 
generation. A brute force redistribution was possible using backorder 
statistics as a guide to manually increasing some input variables and 
decreasing others while keeping total cost constant. This was an iterative 
process which yielded a significant increase in sorties, but which was 


unable to achieve an optimal WRSK. 


Captain Radcliffe developed an algorithm which optimizes WRSK 


allocation. It differed from the current Air Force methodology in that 
it computed a unique shop throughput (base repair cycle) time for each 
LRU. Current algorithms assume the same standard intermediate repair 
time for all LRUs. The AIS environment is so complex and stressed so 
severely during combat support that such an assumption is grossly 
inaccurate. Considering that different LRUs are processed by different 
test stations whose reliability, maintainability, and workload parameters 
differ greatly, it is understandable that each LRU has a unique repair 
cycle time. When WRSK allocations are done with this new insight, a 
better WRSK results. Using the methodology for determining individual 
LRU repair cycle times and the WRSK allocation algorithm developed by 
Captain Radcliffe, a new set of input values for spares variables was 
established. Results of this analysis may be found in the following 


chapter. 
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RESULTS 


Preliminary Phase 


As has already been mentioned, numerous factors were investigated 
during the preliminary phase of the study. The model's sensitivity to 
these factors was of primary interest. A number of important insights 
were gained during this phase which effected the study's subsequent 
direction. The two most important results of this early experimentation 
concerned the impact of avionics spares and manpower on the model's 
behavior. It was apparent from just about every perspective that the 
spares constraint was a critical factor. It was almost as apparent that 
the TAC authorized avionics support manpower was not a critical factor. 
Manpower was therefore assumed to be a minor variable. Further study of 
the manpower constraint was deemed unnecessary. Spares, on the other hand, 
became one of the most investigated factors. 

Cannibalization was observed to be a critical factor. Allowing 
cannibalization resulted in approximately a 50% increase in sortie 
accomplishment over thirty days. Cannibalization was investigated in 
conjunction with other variables, but the results were always the same. 
Because cannibalization is considered a real world maintenance procedure, 
and because it proved to impact sortie generation so dramatically, it was 
made a tundamental part of the model's baseline set of input parameters. 

The impacts of weather and length of flying day were also evaluated. 
The worse the weather modeled, the fewer the number of sorties accomplished. 
Likewise, shortening the flying day resulted in a reduction in sortie 
generation. A davilighe flying window of 16 hours was selected. This 


window went from 0600 to 2200 hours. Weather was eliminated from the model 


to reduce the number of factors being considered and to maximize baseline 
sortie accomplishment. 

The return of avionics LRUs and test station drawers from depot had 
a dramatic impact. Depending on when resupply began, sortie accomplishment 
took a sharp turn upward. Resupply, however, made the model less sensitive 
to spares inputs and AIS performance. In addition, resupply is typically 
considered to begin only after the first thirty days of combat. For these 
two reasons resupply was taken out of the model. All] experiments run during 
the primary phase were run without resupply. Repair cycle time (delay due 
to administrative processing within the intermediate shop and supply) was 
also eliminated after sensitivity analysis indicated its impact was 
negligible. 

The specific arrival day of the AIS was also a factor that had the 
potential of impacting model response. Having an AIS capability was 
demonstrated a critical factor. If the AIS did not arrive at all, sortie 
production was drastically reduced. However, sensitivity analysis indicated 
little difference in model performance as long as the capability became 
available sometime within the first ten days. Day 6 was chosen as the 
operational day for the AIS. 

The preliminary phase also included an extensive review and validation 
of reliability and maintainability input data for both the prime equipment 
and the test stations. The test station failure rates were found to be 
satisfactory. Several failure clocks and network probabilities (particularly 


NRTS probabilities) for prime items, however, required adjustment. 


Baseline Model 


The preliminary phase resulted in some network changes, failure clock 


revisions, and decisions concerning scenario parameters. In this way, a 


baseline model for the primary analysis phase was developed. This model 


served as the control for all subsequent experimentation. All alternatives 


were compared to this baseline. 

Figure 3 shows the sortie generation response of the baseline model. 
The dashed line indicates a hypothetical surge sortie rate goal for the 
first seven days and a sustained combat goal for the following 23 days. 
The downward trend in sortie peneration is obvious. A longer simulation 
would be required to determine where the curve levels out. Jt should 
be noted that this figure does not indicate the actual real world surye 
capability of the F-15 aircraft, bute only the results of a simulation 


model exercised under che scenario parameters stated in Appendix A. 


Because the model does not invorporate quick turn processing and deferrable 


maintenance, it cannot be used to project actual combat capability. 

Figure 4 describes the bascline model in different terms. This 
figure gives many insights into the overall performance of the bascline 
model and the relative impact of the major resource constraints. The 
baseline referred to in the figure actually is the baseline model (2763 
sorties) run with test station drawers unconstrained. The reason is that 
drawers are the first constraint which must be relieved in order to 
increase sorties. The resource constraints are listed from right to 
left in the order they are encountered when trying to increase sortie 
production. Of course, spares could always be increased independently 
with a resulting increase in sorties. towever, for analytical purposes, 
spares were left at baseline levels until no other constraint was 


left to be released. The first constraint which must be released in the 
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model and the one which accounts for the largest single jump in sorties 

is test station drawers. Unconstraining drawers results in an increase 

of 244 sorties over the baseline (2763). Only after drawers are released 
and sortie production is raised does shop manpower become a concern. And 
then it is a relatively minor factor which when unconstrained contributes 
only 58 additional sorties. Once a sufficient number of operators is 

made available (by unconstraining shop manpower), test stations may be 
unconstrained. A sizeable increase of 185 sorties results. This indicates 
that at a certain level of flying activity one set of test stations becomes 
saturated even if all the spare parts and technicians are present to 
operate the stations. The shop workload requires additional test stations. 
When test stations are added to the model, a perfect shop exists. An LRU 
entering the shop for repair is processed immediately. However, sortie 
production can still be improved. Improvements to the AIS, therefore, 

can only go so far to improve avionics availability. Spare LRUs can still 
be in short supply as a result of depot maintenance requirements. The 
second most dramatic increase in sorties occurred when spare parts were 
unconstrained. An increase of 224 sorties resulted. Avionics availability 
was then constrained only by flight line maintenance personnel. When 
flight line manpower was unconstrained, the maximum number of sorties 
possible with the baseline model resulted (3687). This number represents 


approximately a 33% increase above the baseline of 2763. 


WRSK Analysis 


The algorithm developed by Captain Radcliffe for allocating spares 
investment was used to conduct a detailed sensitivity analysis. Spares 


investments ranging from no funding to $40 million dollars were used. 
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The results of this analysis are summarized in Figure 5. The current WRSK 
appears below the curve generated by the Radcliffe algorithm. Although 
not optimal, the current WRSK is clearly past the steepest part of the 
curve indicating that it's not too bad. The curve demonstrates that 
diminishing marginal returns is in effect starting at approximately $8 
million investment. 

Figure 6 illustrates the improvement gained over the baseline when 
using the new allocation algorithm. The current WRSK investment for 
avionics is $13.5 million. Keeping that investment constant and merely 
buying LRUs based on the Radcliffe algorithm resulted in a 6% increase 
in sortie production. Using this algorithm, additions of $2 million and 
$5 million yielded increases in sortie production of 7% and 11% 


respectively. 


Alternatives Compared 


Members of the study team proposed several alternatives for improving 
avionics availability. Experiments were conducted using the model to 
determine the impact of each alternative on sortie production. The 
alternatives were compared to the baseline and to one another. 

The first group of alternatives dealt with prime equipment (avionics) 
reliability and maintainability. Figure 7 describes the effect on sortie 
production of each suggested improvement. These reductions in maintenance 
action rate (50%) were accomplished by doubling the failure clocks 
associated with each subsystem. For instance, the maintenance action 
rate for the radar subsystem was reduced by doubling the nine failure 
clocks belonging to radar LRUs. This experiment yielded a substantial 


increase in sortie production of 335 or 12%. 
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Doubling the failure clocks for the INS, HUD, UHF Radio and the TACAN 
resulted in a small inerease of 27 sorties. By far the most dramatic 
increase in sorties (712) resulted when the maintenance action rate for 
every LRU in che avionics suite was reduced. 

The next group of alternatives dealt with the AIS test equipment. 
Figure 8 depicts the impact of each alternative. Reliability and 
maintainability inputs describing the automatic test stations were improved 
to achieve a 50% reduction in maintenance of the test stations themselves. 
This improvement produced 153 or 6% more sorties. The amount of time 
each LRU occupied any test station was reduced by 50%. This meant shorter 
LRU processing time and fewer test station failures per LRU processed. 

The result was an increase of 234 sorties. The third alternative suggested 
adding a complete set of 7 more test stations. This alternative produced 

a substantial increase of nearly 300 sorties. The final set of alternatives 
proposed changing the number of spare parts available for repairing the 

AIS test equipment. The importance of spare parts is shown in Figure 9. 
When no spare drawers were included in the model, sorties dropped off by 
22%. Doubling the original input quantity of drawers resulted in an 
increase of 140 sorties. Unconstraining drawers (theoretically having 

all the drawers needed during the thirty day scenario) yielded 343 


additional sorties. 


Factorial Analysis 


A full factorial experimental design was employed to analyze the 
interactive effects of several variables. The full factorial design 
consisted of four factors at two levels each. The resulting 16 combinations 


are shown in Table 5. Each combination was replicated 5 times for a total 
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of 80 runs. The two levels for each factor consisted of a low (the base-~ 
Line) level and a high level. The following four factors were addressed: 
1. Prime Equipment Reliability. The 74F@@ (radar) subsystem MTBMA 
at the high level was 1.5 times the baseline clock. 
2. WRSK Spares. Here the high level was represented by additional 


spares costing $2 million above the baseline WRSK cost. 


3. ATE Reliability. The high level involved doubling the baseline 
MTBMA of the automatic test stations. 

4. Test Station Quantity. An additional test station of each type 
was provided at the high level. 

Table 6 summarizes the results of the factorial analysis. The 90% 
confidence interval may be used to determine which effects and interactions 
are significant. Any factor involved in an interaction must be jointly 
analyzed, thus invalidating the reported main effect. Table 6 indicates 
that the only interaction found to be significant was between radar 
reliability and ATE reliability. Although factor (2) could be considered 
a significant main effect an increase in radar MTBb... of 1.5 times really 
is significant only when interacting with an increase in ATE reliability. 
The rest of the interactions were found to be insignificant. The number 
of test stations and spares proved to have significant main effects. A 


detailed explanation of how to analyze the results of factorial experiments 


is given by Box, Hunter, and Hunter [2]. 
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CONCLUSION 


The objective of this study was to identify which of the many factors 
impacting avionics availability are the crucial ones, and to assess the 
relative value of various alternatives for improving avionics availability. 
The results of this study indicate that spares is the single most critical 
factor impacting sortie production. Insufficient spare avionics LRUs is 
currently restricting the combat capability of the F-15 severely. Spare 
parts for the AIS test stations are also critical and in short supply. The 
complexity of the test equipment and the randomness of failures makes stock- 
ing replacement parts difficult. However, the inability of shop personnel 
to keep the AIS test stations operational severely impacts sortie production. 
The presence of the intermediate test equipment and its effective operation , 
in general, is a crucial area. The sensitivity of the model to the 
reliability of the radar subsystem indicates that this single item is of 
critical importance. 

The most attractive alternatives are fairly obvious. Reallocating 
spares funds in a more optimal fashion, along with adding funds for WRSK 
spares is a very good idea. Improving the reliability and maintainability 
aspects of the radar, if it were possible, would certainly by worthwhile. 
Buying additional test stations seems like the most practical alternative 
for the present system, but not necessarily the best for a future system. 

In conclusion, the Logistics Composite Model is a powerful tool which 
may be used extensively during the development and acquisition process of 
new weapon systems. That is the main point of this report. My purpose was 
to document the use of LCOM and simulation analysis in the Avionics 
Availability Study with the hope that our work may serve as an example for 


other studies. 
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APPENDIX A 


Appendix A contains the Operations and Maintenance Scenario developed 
for the AAS LCOM analysis. This scenario follows the format suggested 
by AFR 25-8. Although this scenario was not coordinated at HQ USAF or 
HQ TAC, it does include much of the official TAC F-15 scenario published 


in the TAC LCOM Manpower Study Final Report dated September 1979. 
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AAS LCOM SCENARIO 


1. GENERAL REQUIREMENTS 

a. A 48 PAA F-15 unit will be modeled. 

b. Manpower availability is 309 manhours per month (surge manning). 

c. The direct utilization rate in all shops will be the largest 
percentage obtainable without decreasing the prescribed utilization rate. 
It will be assumed that the indirect work can be accomplished in the 
remaining time. 

d. Standard manning for the Deputy Commander for Maintenance Staff, 
squadron overhead, and non-simulated workcenters will be identified by 
HQ TAC/XPM using current standards, criteria, or manning document extractions. 


e. No cross utilization will be considered. 


2. FACILITIES AND DEPLOYMENT 

a. Number of locations and PAA size at each site: 

(1) A 48 PAA deploying to a forward location. 

b.. Unit will deploy with WRSK. Avionics intermediate shop (AIS) will 
arrive on day 5. 

c. Resupply time is in excess of the hices day simulation time and 
will not be considered in this study. 

d. One set of avionics test stations (3 automatic and 4 manual) will 
be available. 

e. Full off-equipment maintenance capabilities will be modeled. 

f. Aircraft may be returned to Mission Capable (MC) status via 


cannibalization, remove and replace, or remove, repair, and reinstall 


actions. 


_ 
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t 
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g. Aircraft will be parked in TAB V Shelters which will allow taxiing 


Cees 
- 


out but require towing/winching in. 


: 


3. MISSION REQUIREMENTS 


a. Mission Types: 


(1) CAP -=- Combat Air Patrol (26% of total sorties) 
(2) ESC - Escort (12%) 
(3) AA - Air-to-Air (43%) 


(4) ALRT - Alert (19%) 


b. The only aircraft type involved in this model is the F-15. 

c. The CAP, ESC, and AA missions have the same initial configuration. 
The ALRT mission has a unique initial configuration. 

d. Probability of load and quantity expended: Tanks are jettisoned 
on 30% of the missions. 10% of missions require loading gun. 

e. The CAP, ESC, and AA missions have the same ending configuration 
as initial configuration. The ALRT mission has a unique ending 
configuration. 

f. Substitution rules for using alternative configuration: not 
applicable. 


g. ALRT missions have a priority of 1. CAP, ESC, and AA missions 


have a priority of 2. 
h. Each CAP, ESC, and AA mission requires two aircraft. Mission will 
abort if only one is ready at cancel time. ALRT missions involve only one 


aircraft. 
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i. Requested sortie rate is 3.95 sorties/aircraft/day. Mean sortie 


lengths: 
(1) CAP - 1.5 hours 
(2) ESC - 1.4 hours 
(3) AA - 1.6 hours 
(4) ALRT - 1.2 hours 


j- Recovery will be at home station. 
k. No air refueling. 


1. Night Missions: 


(1) CAP - 10% 
(2) ESC - 5% 
(3) AA - 10% 


(4) ALRT - 20% 


m. No weather limitations by mission type exist. 


n. Cancel Times: 


(1) CAP - 1.0 hours 
(2) ESC - -3 hours 
(3) AA - -5 hours 
(4) ALRT -  .2 hours 


o. Extent of operations of mission peculiar equipment: not applicable 


to this study. 


4. OPERATIONS AND SCHEDULING POLICY 


a. Except for alert missions, when takeoff/recovery weather is fore- 


cast to be below 200 ft. or less than 1/2 mile visibility, the mission is 


delayed. If delay lasts longer than cancel time, the mission is cancelled 


due to weather. 

b. No air aborts considered. 

c. Spare aircraft will be prepared for the first of each mission 
type each day, with the exception of ALRT. 

d. Aircraft will be turned as required to meet requested sortie 
rate. 


e. Day missions are defined as being between the hours of 0600 and 


f. Mass launches, consisting of 10 aircraft, will vary throughout 


daylight hours. The probability for mass launches: 


# Per Day Probability of Occurrence 
i¢) «133 
1 -600 
2 -267 


5. GROUND ALERT 

a. Eight aircraft per 48 PAA will be on 24 hour alert. 

b. Alert aircraft can only fly ALRT missions. 

c. 20% of all sorties are ALRT. 

d. Alert aircraft will be replaced immediately. 

e. Duration of alert cycle is 7 days. 

f. Prior to standing alert, aircraft will have avionic and weapon 
release system check accomplished. The aircraft will then be serviced, 
loaded with munitions, and towed to the alert area. At end of cycle, an 


ALRT mission will be flown. 
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6. FUNCTIONAL CHECK FLIGHT (FCF) 


a. Not included in surge combat. 


7. MAINTENANCE CONCEPTS AND ORGANIZATION 


a. Organization structure will be as outlined in AFR 66-1. 

b. Integrated avionics maintenance will be used. 

c. Quick turns will be attempted, but deferred maintenance is not 
modeled. 

d. Remote vs home station maintenance: not applicable to this 
study. 

e. Launch support teams consisting of avionic, ECM, pneudraulic, 
electric, and engine specialists will be utilized. These teams will be 
supported by a dedicated vehicle and spare LRUs via Red Ball Transportation. 

f. Aircraft munitions download for maintenance will be required 
IAW T.O. 11A4-1-33 and the applicable aircraft ~33 and -2 technical orders. 

g. Repair will be to the system level indicated by historical data. 
Field maintenance will be performed where possible. LRUs will be taken 
to the shop for repair. 

h. Phase and corrosion inspections will be deferred during surge 
activity. 

i. Gun inspections, other than daily inspection, will be based on 
number of rounds fired (15,000 - 30,000 - 60,000). 

j» Time Change Irems (TCL) are inherently included in maintenance 


data, therefore, TCI will not be specifically scheduled. 


8. COMBAT DAMAGE 


Combat damage will not be considered in this study. 
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One of the most important factors to consider when evaluating avionics 
availability is mean time between removal for each avionics component. 
For supply purposes, this parameter is usually termed mean time between 
demand (MTBD). Clearly, the removal frequency of any LRU impacts both 
supply requirements and operational readiness. Removal frequency is 
a function of LRU reliability, maintainability and testability. These 
factors also account for test station workload within the AIS. 

Data for LRU MTBD is available from AFM 66-1 maintenance data. The 
MTBD values collected from 66-1 should be accurate. The following six 
tables list LRU MTBD by test station for all seven test stations. A 
composite MTRD for the test station is also provided. The removal rates 
being experienced by the original TAC LCOM model may be compared to field 
data (66-1) for the year 1979 from Langley AFB, Luke AFB, Eglin AFB, and 
Bitburg AB. Where significant differences were noted, LCOM system clocks 


were revised to reflect the combined 1979 field data. 
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MODEL REDUCTION 
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APPENDIX C 


Appendix C contains a list of the subsystem clocks and networks 
oc which were deleted from the model to reduce its execution costs. It 
also contains a list of the scheduled maintenance clocks which were 


a part of the original TAC F-15 database, but were deleted when the 


model was reduced. 
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APPENDIX D 


RESOURCES CONSTRAINED 
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APPENDIX D 


Appendix D contains a list of the seventy-five LRUs, six maintenance 
workcenters, and seven test stations which were constrained in the F-15 


LCOM model. 
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APPENDIX E 


ORIGINAL DRAWER FAILURE CLOCKS 


- | APPENDIX E 


ds 
Appendix E lists the original test station failure clocks. They 


are Listed for each test station by drawer and are given in terms of 


LRUs processed between failure. 
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TABLE E.1 - COMPUTER FAILURE CLOCK SUMMARY 


DRAWER FAILURE CLOCK 
POWER DISTRIBUTION PANEL 739 
AUXILIARY B CARD FILE "148 
PROGRAMMABLE TRANSFORMER CONVERTER 303 
WAVEFORM SIGNAL GENERATOR 341 
PNEUMATIC PRESSURE GENERATOR 50 
PNEUMATIC PRESSURE SUPPLY 50 
DIA AUXILIARY 174 
PRECISION POWER SUPPLY 45 
TEST STATION POWER SUPPLY 739 
PRECISION SYNCHRO UNIT 162 
CCDP 739 
PRINTER 114 
DMM 148 
OSCILLOSCOPE 243 
PUNCH TAPE READER 23 
SAMPLING ANALYZER 122 
DATA COUPLER 122 
POWER SUPPLY ASSEMBLY 136 
ACRPS 732 
LF COUNTER 73 
SWITCHING COMPLEX 32 
DIA 52 
SCORSBY TABLE 1 
ROUTE OF TURN SYSTEM 42 
ATTITUDE SIMULATOR 33 
MASS STJRAGE UNIT 370 
ENTIRE TEST STATION 82 
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TABLE _E.2 - MICROWAVE FAILURE CLOCK SUMMARY 


DRAWER 


LRU BLOWER PANEL 
PULSE GENERATOR 
MSSU 

PHASEMETER 
IMPEDENCE UNIT 

LF COUNTER 

DIA AUXILIARY 

LRU POWER SUPPLY #2 
CCDP 

SCOPE 

SPECTRUM ANALYZER 
NOISE ANALYZER 
X-BAND SIGNAL GENERATOR 
DMM 

DIA 

SAMPLING ANALYZER 
DATA COUPLER 

ACRPS 

HF COUNTER 
SWITCHING COMPLEX 
AUXILIARY A 
AUXILIARY B 

MSU 

LRU BLOWER 

IF SIGNAL GENERATOR 
ENTIRE TEST STATION 


FAILURE CLOCK 


451 
249 
17 
225 
, 63. 
107 
25 
226 
475 
238 
36 
51 
45 
95 
18 
68 
158 
429 
36 
34 
475. 
119 
475 
451 
32 
158 
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TABLE E.3 - DISPLAYS FAILURE CLOCK SUMMARY 
ae DRAWER FAILURE CLOCK 
; DATA COUPLER 56 

DIA 8 
POWER SUPPLY ASSEMBLY #1 36 
POWER SUPPLY ASSEMBLY #2 213 
: LRU BLOWER PANEL 155 
ay DIA AUXILIARY 74 
CCDP 44 
LRU POWER SUPPLY 160 
, SIGNAL WAVEFORM GENERATOR 39 
DMM 130 
aa LF COUNTER 51 
f IMPEDENCE UNIT . 137 
e 3 
: PRINTER 130 
oe - SAMPLING ANALYZER 56 
i SWITCHING COMPLEX 37 
: DISPLAY UNIT TEST ASSEMBLY 120 
a ENTIRE TEST STATION 52 
é 
@ 
“ 80 
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TABLE E.4 - CNI FAILURE CLOCK SUMMARY 


DRAWER 


POWER DISTRIBUTION PANEL (PDP) 
FREQUENCY COUNTER 
DIGITAL MULTIMETER (DMM) 
OSCILLOSCOPE 

AM/FM SIGNAL GENERATOR 
TACAN CONTROL PANEL 

UNF CONTROL PANEL 

POWER SUPPLY ASSEMBLY 
TACAN TEST SET 

IFF PANEL 

CONTROL PANEL (SRI) 
RF/RMS VOLTMETER 

ILS TEST SET 


RADAR TEST SET 


ENTIRE TEST STATION 


FAILURE CLOCK 


276 
113 
207 
135 
55 
96 
55 
828 
24 
7, 
138 
438 
33 
41 
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TABLE E.5 - 1 & C FAILURE CLOCK SUMMARY 


DRAWER 


SYNCHRO TEST PANEL 
MANUAL STIMULUS ASSEMBLY 
RELAY GROUP 

VARLABLE AC POWER SUPPLY 
VARIABLE DC POWER SUFFLY 
AC/DC POWER SUPPLY 

DMM 

SCOPE 

MANUAL SIGNAL GENERATOR 
GCU CENTRAL PROCESSOR 

DC MILLIVOLT SIGNAL, GENERATOR 


ENTIRE TEST STATION 


82 


FAILURE CLOCK 


202 


TABLE E.6 - ANTENNA A FAILURE CLOCK SUMMARY 


DRAWER 


LRU BLOWER PANEL 

SERVO SIGNAL GENERATOR 

POWER SUPPLY ASSEMBLY 
ANTENNA CONTROL & DISPLAY PANEL 
DMM 

SCOPE 

XL SIGNAL GENERATOR 

TRANSFER FUNCTION ANALYZER 
LVPS CONTROL & DISPLAY PANEL 
ANTENNA POWER SUPPLY 

STATION POWER SUPPLY 

ENTIRE TEST STATION 

VARIABLE TRANSFORMER 


LVPS PRIMARY POWER CONTROL 


FALLURE CLOCK 


TABLE E.7 - ANTENNA B DRAWER FAILURE CLOCKS 


DRAWER 


PDP 


TRANSMITTER, PULSE GENERATOR 


TRANSMITTER, CONTROL & DISPLAY PANEL 


TRANSMITTER, POWER SUPPLY 

DMM 

SCOPE 

HF SPECTRUM ANALYZER 

NOISE ANALYZER 

STATION POWER SUPPLY 

LF SPECTRUM ANALYZER 

TRANSMITTER, PRIMARY POWER CONTROL 


ENTIRE TEST STATION 
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APPENDIX F 


Reliability data on the AIS test equipment was difficult to obtain. 
Headquarters TAC used specially collected maintenance data from Langley AFB 
\.. for the year 1977 to determine test station reliability and maintainability 
inputs to the F-15 LCOM model. The complex drawer architecture of the test 
equipment makes it difficult to validate maintenance data or to verify the 
composite test station reliability being exhibited by the model. 

AFM 66-1 maintenance data for 1979 from Eglin AFB, Luke AFB, and 
Btehuce AB, was obtained to determine field test station reliab: lity. The 
three automatic stations occupied the center of attention throughout the 
study due to their poor performance relative to the manuals. For this 
a reason, field data was examined for the automatics only. This data was 
extracted from base maintenance records (magnetic tapes) via the Common 
Data Extraction Program (CDEP). Work Unit Codes (WUC) are listed here to 
a distinguish test station drawers. The number of maintenance actions and 
total maintenance manhours are listed by the WUC each was involved in 
w repairing. Drawer descriptions (a complete list of system components) 
corresponding to the listed WUC are contained in T.0O. 51-1-06-1 for the 
automatic stations and in T.O. 00-25-66-2-2 for the manuals. 

Since operating hours for the test equipment is not included in base 


data, a standard reliability measure (MTBF or MTBMA) in terms of operating 


ia. 


hours cannot be calculated. This was not a problem since the only composite 
measure of test station reliability available from the model was in terms 
of LRUs processed per failure. And this measure could be calculated from 


> the field data. CDEP was used to extract the totai number of LRUs processed 


a 86 


by each test station at the three bases for 1979. This along with the 


total failures for each station during that year provides the measure needed. 


vy Table F.1 summarizes these computations. 
\. 
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MICROCOPY RESOLUTION TEST CHART 


NATIONAL BUREAU OF STANDARDS-1963-A 


TEST STATION RELIABILITY (66-1 DATA) 


COMPUTER TEST STATION 


MA INTENANCE MAINTENANCE MA [NTENANCE MAINTENANCE 


DRAWER ACTIONS(EGLIN)  tHOURS(EGLIN) ACTIONS(LUKE) HOURS(LUKE) 
FAAO 12 141 23 302 

FAAA 1 2 - 1 ‘ 
FAAB 1 1 6 56 

FAAG - 4 3 52 

FAAL ~ 6 5 18 

FAAP 1 6 2 20 

FAAR 1 34 3 30 

FAAU 3 21 5 18 

FAAY 1 20 it 58 

FAAZ - - 1 1 

FAA2 2 4 5 13 

FAAT - - 1 t 

FABA 4 9 2 27 

FABJ - 7 10 59 

FABK 2 4. = s 

FABM - a a 

FABR 3 19 4 18 

FABT - - 2 5 

FABZ 1 3 4 5 

FAB3 1 5 2 2 

FAB5 - : 2 4 

FAB? 5 12 6 9 

FACD 7 121 38 244 

FACE 3 5 3 4 

FACF 1 2 4 12 

FACG - = ! 1 

FACK 4 57 14 141 

FACIL. 1 4 2 1 

FACR 5 15 2 18 

FACT 1 2 1 5 

FACA - - 2 2 

FADB - - 1 2 

FADD - : = ‘ 

FAEA - - 7 113 | 
FAEB 2 17 3 17 : 
FAEI - - 1 5 

FAE2 1 1 2 Ty 


Total 63 515 ; 178 1277 


TEST STATION RELIABILITY (66-1 DATA) 


COMPUTER TEST STATION 


DRAWER 


FAAO 
FAAA 
FAAB 
FAAF 
FAAG 
FAAP 
FAAR 
FAAU 
FAAY 
FAA5 
FAA? 
FABA 
FABC 
FABJ 
FABK 
FABM 
FABR 
FABT 
FABZ 
FAB? 
FACD 
FACF 
FACK 
FACL 
FACR 
FACT 
FAC7 
FAEA 
FAEB 
FAEC 
FAE2 


Total 


MAINTENANCE 
ACTIONS( BITBURG ) 
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MAINTENANCE 


HOURS (BITBURG) 


TEST STATION RELIABILITY (66-1 DATA) 


oe DISPLAYS 


ae MAINTENANCE MAINTENANCE MAINTENANCE MAINTENANCE 
ie DRAWER ACTIONS(EGLIN) HOURS (EGLIN) ACT LONS ( LUKE) HOURS ( LUKE) 


note FAMO 18 290 14 358 
a FAMA 2 3 - - 
FAMC j 20 2 15 

FAMF 1 1 = 8 

FAMH 3 17 2 7 

FAMP 10 115 12 166 

FAMQ 2 1 ee 4 

FAMT 6 34 1 1 

FAMV 2 10 3 46 

FAMZ - - 2 3 

FAM2 4 16 5 60) 

7 FAM5 5 25 8 12 
af FANE - = iE 1 
FANG - 2 3 4 
FANK 3 12 ) 66 

FANM - = 2 8 

FANP 5 22 1 21 

FANR 2 6 - - 

. FANU 10 39 ! 
2 FANW 3 8 1 I 
os FANZ - - 2 ae’: 
Bins FANG 3 20 2 3 
wo FAN6 4 17 - - 
, FAN9 4 7 2 6 
a FAPA 4 24 6 48 
FAPB 1 1 1 1 

re FAPE 3 19 5 55 
ih FAPH 11 71 14 162 
“ FAPJ 1 2 - - 
FAPK 4 4 10 16 
ae FAPN 3 43 4 29 
a FAPP - 1 - = 
FAPV 1 1 - = 

FAP2 2 11 - 2 

ae FAPG 1 4 = ‘ 
‘© FAP? 4 27 2 8 
FARA 2 11 1 1 

FARB 5 56 6 38 

FARI - - 1 3 
2 FAR2 - - | 2 
me FAR3 - - 1. 7 
é FAR8 - 2 - - 
Total 130 942 125 1153 


DISPLAYS 


DRAWER 


FAMO 
FAMA 
FAMC 
FAMH 
FAMP 
FAMT 
FAMV 
FAMX 
FAMZ 
FAM2 
FAMS 
FAM6 
FAM? 
FANE 
FANK 
FANP 
FANU 
FANW 
FANZ 
FANS 
FAN6 
FAN9 
FAPA 
FAPE 
FAPH 
FAPJ 
FAPK 
FAPM 
FAPN 
FAPP 
FAPV 
FAPY 
FAP2 
FAP4 
FAP? 
FARA 
FARB 
FARF 
FAR1I 
i FAR3 
FAR8 


Total 
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TEST STATION RELIABILITY (66-1 DATA) 


MAINTENANCE MAINTENANCE 


ACTIONS (BITBURG) HOURS ( BITBURG ) 
15 “111 
1 ee 4 
47 
3 4 
8 59 
9 61 
2 5 
1 1 
1 1 
2 32 
8 20 
3 5 
1 1 
2 
2 31 
7 
6 7 
1 8 
1 
2 31 
3 4 
2 8 
9 47 
1 17 
19 72 
1 1 
5 27 
2 3 
2 1 
1 
1 2 
3 5 
1 2 
9 74 
5 25 
1 2 
1 3 
1 2 
1 
131 735 
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TEST STATION RELIABILITY (66-1 DATA) 
RS 


a MICROWAVE : 

oo MAINTENANCE MAINTENANCE MAINTENANCE MAINTENANCE 

ae DRAWER ACTIONS(EGLIN) HOURS(EGLIN)  ACTIONS(LUKE) HOURS (LUKE ) 

FAYO 9 122 9 136 
FAYC = 2 2 6 
FAYE < = 1 4 
FAYG E . 4 47 
FAYK 16 89 11 45 
FAYS 2 3 1 1! 
FAYW 1 1 2 3 
FAY! 6 1 4 10 
FAYS 4 16 5 25 
FAY9 2 4 1 3 
FAZC 2 29 5 16 
FAZD 2 = 4 8 
FAZE 2 4 ee = 
FAZK ss 1 1 a 
FAZQ 7 1 - 1 
FAZS 7 16 4 20 
FAZV 1 6 4 22 
FAZY - e 7 2 
FAZ\ 7 2 1 3 
FAZ3 1 1 4 62 
FAZ8 = - 1 1 
FA1B 2 14 15 261 
FAIC “ Bs 1 1 
FAIF 2 16 1 2 
FAIG - . Z 
FAIK 1 2 1 1 
FAIN < “ 3 38 
FAIP - 1 oF = 
FALU 3 13 16 88 
FALV - e 3 18 
FAIW 3 5 6 13 
FAIX . < 1 2 
FALLS 2 = 3 1 
FA2B - 1 Ss 2 
FA2K “ = - 2 
FA2N 7 = 1 1 
FA2Q - = es ie 
FA3A ; 11 7 65 
FA3B 2 13 7 21 
FA3C e = 1 2 
FA31 < % 1 5 
FA32 re = 1 1 
FASA 2 22 7 96 
FAC 2S pane ae Sok 

Total 62 397 139 1036 
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TEST STATION RELIABILITY (66-1 DATA) 


MICROWAVE 
: MAINTENANCE MAINTENANCE 
a DRAWER ACTIONS (BITBURG) HOURS(BITBURG) 
FAYO 36 437 
FAYA 1 
, FAYB 4 36 
: FAYC 4 70 
FAYG 3 36 
FAYK 54 747 
FAYS 1 5 
FAYU 4 24 
™ FAYX 1 
ie FAY1 7 21 
- FAY5 2 5 
ee FAY6 3 19 
” FAY9 2 9 
FAZC 6 16 
FAZE 2 8 
FAZQ 2 14 
FAZ5 6 42 
FAZV 1 20 
me FAZ1 4 7 
a FAZ3 3 2 
we FAZ8 1 3 
* FAIB 11 128 
as FAIC 1 2 
= FAIF 6 42 
2 FAIK 1 
FA1N 2 9 
FA1P 2 4 
- FA1U 18 141 
a FAIV 
oa FA1W 5 27 
ss FA14 1 15 
a FA2B 1 
ae FA2G : 1 
Ee FA2K 2 
ae FA3B 2 18 
ol FA32 3 2 
ce FA33 1 5 
: FA4A 28 202 
sar) FA4B 1 1 
oe 
“N 
a Total 223 2124 
‘@ 
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TABLE F.1 TEST STATION RELIABILITY DATA 


MAINTENANCE ACTIONS (1979 66-1 Data) 


Eglin Luke = Bitburg Total | 
Computer Station 63 170 99 332 ! 
Microwave Station 62 139 223 424 
Displays Station 130 125 131 386 


LkUs PROCESSED (1979 66-1 Data) 


Eglin Luke Bitburg Total 
Computer Station 418 620 675 1713 
Microwave Station 307 405 325 1037 
Displays Station 297 473 516 1286 


TEST STATION RELIABILITY (Combined) 


LRUs/Failures 


Computer Test Station 5.16 
Microwave Test Station 2.45 


Displays Test Station 3.33 


: APPENDIX G 


F-15 LCOM DATABASE 
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ae APPENDIX G 


The entire F-15 LCOM database as it was run during the primary analysis 
phases follows. This appendix contains the entire LCOM Forms File. This 
includes all the reliability and maintainability input parameters which 


define the model. Many operational and logistics inputs may also be found. 
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